OpenStack Juno : Use Virtual Storages(NFS)
2015/01/11 |
It's possible to use the Virtual Storage provided by Cinder
if an Instance needs more disks.
Configure Virtual storage with NFS backend on here.
+------------------+ 10.0.0.50| [ Storage Node ] | +------------------+ +-----+ Cinder-Volume | | [ Control Node ] | | eth0| | +--------------+ | Keystone |10.0.0.30 | +------------------+ 10.0.0.40| | | Glance |------------+------------------------------------+ NFS Server | | Nova API |eth0 | +------------------+ eth0| | | Cinder API | | eth0| [ Compute Node ] | +--------------+ +------------------+ +-----+ Nova Compute | 10.0.0.51| | +------------------+ |
[1] |
NFS server is required to be running on your LAN.
On this example, configure "/storage" directory on "nfs.srv.world" as a shared directory. |
[2] | Configure Storage Node. |
[root@storage ~]#
yum -y install nfs-utils
[root@storage ~]#
vi /etc/idmapd.conf # line 5: uncomment and change to the own domain name Domain = srv.world
[root@storage ~]#
for service in rpcbind nfs-lock nfs-idmap nfs-mountd; do
systemctl restart $service systemctl enable $service done
[root@storage ~]#
vi /etc/cinder/cinder.conf # add follows in the [DEFAULT] section
volume_driver=cinder.volume.drivers.nfs.NfsDriver
nfs_shares_config=/etc/cinder/nfs_shares nfs_mount_point_base=/var/lib/cinder/mnt
[root@storage ~]#
vi /etc/cinder/nfs_shares # create new: specify NFS shared directories nfs.srv.world:/storage chmod 640 /etc/cinder/nfs_shares [root@storage ~]# chgrp cinder /etc/cinder/nfs_shares [root@storage ~]# mkdir /var/lib/cinder/mnt [root@storage ~]# chown cinder. /var/lib/cinder/mnt [root@storage ~]# systemctl restart openstack-cinder-volume |
[3] | Change Nova settings to mount with NFS. |
[root@node01 ~]#
yum -y install nfs-utils
[root@node01 ~]#
vi /etc/idmapd.conf # line 5: uncomment and change to the own domain name Domain = srv.world
[root@node01 ~]#
for service in rpcbind nfs-lock nfs-idmap nfs-mountd; do
systemctl restart $service systemctl enable $service done
[root@node01 ~]#
vi /etc/nova/nova.conf # add follows in the [DEFAULT] section volume_drivers="nfs=nova.virt.libvirt.volume.LibvirtNFSVolumeDriver" systemctl restart openstack-nova-compute |
[4] | For example, create a virtual disk "disk01" with 10GB. It's OK to work on any node. (This example is on Control Node) |
[root@dlp ~(keystone)]# cinder create --display_name disk01 10 +---------------------+--------------------------------------+ | Property | Value | +---------------------+--------------------------------------+ | attachments | [] | | availability_zone | nova | | bootable | false | | created_at | 2015-01-11T14:35:07.860579 | | display_description | None | | display_name | disk01 | | encrypted | False | | id | ad3c6f06-e5c1-4185-b640-687b2b6369f0 | | metadata | {} | | size | 10 | | snapshot_id | None | | source_volid | None | | status | creating | | volume_type | None | +---------------------+--------------------------------------+[root@dlp ~(keystone)]# cinder list +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | ad3c6f06-e5c1-4185-b640-687b2b6369f0 | available | disk01 | 10 | None | false | | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ |
[5] | Attach the virtual disk to an Instance. For the exmaple below, the disk is connected as "/dev/vdb". It's possible to use it as a storage to create a file system on it. |
[root@dlp ~(keystone)]# nova list +-----------+-----------+---------+------------+-------------+-----------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +-----------+-----------+---------+------------+-------------+-----------------------------------+ | e2785612- | CentOS_70 | SHUTOFF | - | Shutdown | int_net=192.168.100.6, 10.0.0.201 | +-----------+-----------+---------+------------+-------------+-----------------------------------+[root@dlp ~(keystone)]# nova volume-attach CentOS_70 ad3c6f06-e5c1-4185-b640-687b2b6369f0 auto +----------+--------------------------------------+ | Property | Value | +----------+--------------------------------------+ | device | /dev/vdb | | id | ad3c6f06-e5c1-4185-b640-687b2b6369f0 | | serverId | e2785612-28be-4460-9e77-93c8f78b296d | | volumeId | ad3c6f06-e5c1-4185-b640-687b2b6369f0 | +----------+--------------------------------------+ # the status of attached disk turns "in-use" like follows [root@dlp ~(keystone)]# cinder list +--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+ | ad3c6f06-e5c1-4185-b640-687b2b6369f0 | in-use | disk01 | 10 | None | false | e2785612-28be-4460-9e77-93c8f78b296d | +--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+ |